COMPUTER 
RECREATIONS 

An expert system outperforms mere mortals 
as it conquers the feared Dungeons of Doom 

by A. K. Dewdney 



Every year thousands of people die 
a fantasy death in the Dungeons 
of Doom while playing Rogue, 
one of a new generation of computer 
adventure games. The player watches 
a map of the dungeons on the display 
screen and directs the actions of his or 
her game persona, a character called 
the Rogue. The object of the game is to 
descend through the 26 levels of the 
dungeons, seize the Amulet of Yen- 
dor and return safely to the surface, 
gathering gold and slaying or escap- 
ing from monsters along the way. Few 
human players survive the dangers of 
this subterranean odyssey, let alone 
return with the amulet. 

The fantasy can be quite vivid; one 
quickly leaves awareness of keyboard 
and display screen far behind. As the 
Rogue, I approached the entrance to 
the dungeons with some trepidation: it 
was night and the ancient ruins that 
marked the point of my imminent de- 
scent had a gloomy and forbidding ap- 
pearance. In preparation I set out my 
enchanted mace, a bow and a quiver 
of arrows snatched from a dragon's 
hoard in the distant Dark Mountains. I 
donned my elf-crafted armor, picked 
up my weapons and food and stepped 
into the stygian darkness of a stairway. 

Just as the descent began to seem 
endless, I bumped into an oaken door 



and swung it cautiously open. There 
before me was the first room on the 
uppermost level of the Dungeons of 
Doom. It was dimly lighted by tapers 
and I trod carefully to the middle of 
the chamber, the better to survey it. 
Suddenly the floor under me gave way 
and for a breathless second I was fall- 
ing. With a sickening thud I landed 
in another room. This one was much 
darker and, even when my eyes be- 
came accustomed to the dark, I could 
see only a few feet in any direction. 
To make matters worse, I could hear 
something moving about in this cham 
ber. Nauseous with fear, 1 stumbled to 
my feet to find myself confronting a 
squat, horrid armor-clad figure hold- 
ing a club. As it raised its weapon to 
strike, a rush of adrenalin cleared my 
head. 1 fitted an arrow to my bow, drew 
it and fired all in one fluid motion. 
(Fortunately 1 took archery as a non- 
credit course in my senior year.) There 
was a swish, a thwock and a squeal as 
the goblin (for that is what the creature 
was) fell to the floor quivering with 
unvented rage. 1 stepped gingerly away 
from it, determined to find a stair- 
way up and out of the Dungeons of 
Doom. I thought of my cozy home and 
my writing desk with the unfinished 
"Computer Recreations" article on it. 
As I shuffled slowly in the direction 



in which I guessed a stairway to lie, my 
boot struck what felt like a small heap 
of stones. 1 looked down. Even in the 
dark something gleamed. Gold! It oc- 
curred to me to explore just one more 
room before returning to the surf ace 

Aside from the intensity of vicarious 
experience, Rogue goes a step beyond 
traditional adventure games in at least 
two respects. First, the layout of the 
terrain is generated by the program it- 
self and the layout changes from one 
game to the next. Second, Rogue sup- 
plies the human player with a plan 
view of the current level of dungeons 
as explored so far [see illustration on 
this page]. Various features are indi- 
cated by different keyboard charac- 
ters drawn on the screen. For exam- 
ple, bars and hyphens represent walls, 
number and percent signs represent 
passages and stairways respectively, 
plus signs represent entrances and car- 
ets represent traps. Objects and fea- 
tures of the chamber may or may not 
be visible depending on whether or not 
the chamber is illuminated. When the 
Rogue enters this particular level, no 
features are shown on the screen. In 
order for them to be represented the 
Rogue (represented by an "at" sign) 
must discover them. And so he ex- 
plores, stumbles on some traps, scouts 
parts of various rooms and traverses 
passageways. He may encounter the 
letter U, which represents a monster 
known as the Umber Hulk. 

Below the character-oriented graph- 
ic plan the screen displays the Rogue's 
current statistics. In the illustration the 
Rogue is on the 25 th level, he has accu- 
mulated 7,730 pieces of gold, he has 
earned 77 hit points (but only 25 re- 
main because of damage sustained), he 
has accumulated strength to the 15th 
degree (18 is the highest), he wears 
class-9 armor and has 30,668 experi- 
ence points, enough to place him on 
the exalted 13th order of experience. 
At the 25th level of the Dungeons of 
Doom this Rogue has only one more 
stairway to descend before reaching 
the bottom level and attempting to 
snatch the coveted Amulet of Vendor. 
The Rogue must first dispose of the 
Umber Hulk, however. 

This discussion explores only the 
surface of the game. It would be possi- 
ble to write an entire book of rules and 
advice for playing Rogue. So far the 
only available document of that na- 
ture is a terse, eight-page report writ- 
ten by Michael C. Toy and Kenneth C. 
R. C. Arnold, A Guide to the Dun- 
geons of Doom [see "Bibliography," 
page 128]. Unfortunately it is avail- 
able only to users of the vax/unix 
time-sharing system. Arnold tells me 
that a version of Rogue suitable for 
the IBM PC is now available from A.I. 
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The 25th level of the Dungeons of Doom 
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@ 


the Rogue 


h 


move one space west 


-1 


walls of rooms 


1 


move one space soutfi 


+ 


doorway 


k 


move one space nortfi 


# 


passage between rooms 


1 


move one space east 




floor of room 


> 


descend stairway 


% 


staircase 


< 


ascend stairway 


y\ 


trap 


m 


move onto sometfiing 


) 


weapon 


s 


searcfi for trap 


] 


piece of armor 


A 


identify trap 


« 


gold 


./e 


rest/eat 


! 


flask of potion 


W/T 


wear/take off armor 


? 


magic scroll 


P/R 


put on/remove ring 




food 


d 


drop an object 


/ 


magic wand 


q 


quaff a potion 




magic ring 


r 


read a scroll 


A— Z 


uppercase letters 


Z 


zap with magic wand 




denote denizens 


t 


throw an object 




of dungeons 


w 


wield a weapon 






f 


fight to the death 



Map symbols (left) and commands for the game of Rogue 



Design, 201 San Antonio Circle, Suite 
115, Mountain View, Calif. 94040. 
Toy and Arnold, Rogue's creators, 
evidently think the best way to learn 
the game is to play it. Nevertheless, 
the general features of the game can 
be delineated. 

At each level the playing area is di- 
vided into squares. The Rogue occu- 
pies one square at a time as he explores 
his vicinity. Movement within rooms 
and passages is controlled by typed let- 
ter commands such as h, j, k and / that 
move the Rogue a single square in 
one of the four main directions. Oth- 
er commands produce diagonal move- 
ment or continued motion in a given 
direction. To make the Rogue ascend 
or descend a stairway, the player must 
type the character < or > . 

When an object is discovered near 
the Rogue's current location, moving 
the Rogue to the square containing the 
object automatically causes the object 
to be picked up. If the player wants to 
move onto that square without picking 
up the object, he or she must type m 
followed by the appropriate direction 
character. It is also possible to have the 
Rogue search for traps by typing s, an 
action that effects a search of neigh- 
boring squares. A caution is in or- 
der: this search has only a 20 percent 
chance of discovering a trap. 

Occasionally the Rogue must rest 
(type a period) or eat (type an e) to 
regenerate strength expended in wan- 
dering about or in subduing monsters. 
Apart from a limited amount of food 
carried in a backpack, the Rogue has 
nothing else to eat except what can be 
found on the dungeon floors (unappe- 
tizing as this may sound). 

When a piece of armor is found, the 
Rogue may pick it up (automatically 
placing it in the backpack) or wear it 
(type a W). Armor naturally gives the 
Rogue more protection in combat, but 
armor may be cursed. If the armor 
is cursed, efforts to take it off (type a 
T) are useless without a magic scroll 
that breaks the curse. Any magic rings 
found by the Rogue may be put on 
(type a P) or removed (type an R) un- 
less they are cursed. 

At times it becomes necessary for 
the Rogue to drop a flask and a scroll 
or two (type a d followed by an object 
character) because his pack is full. (A 
Rogue in full pack cannot pick up ar- 
mor.) Before dropping a flask, how- 
ever, the Rogue might benefit from 
drinking the unknown contents: some 
potions have a healing effect and oth- 
ers enable the Rogue to see the Invisi- 
ble Monster. On the other hand, the 
potion may merely cause confusion, so 
that if one types a command for the 
Rogue to move north, he may wander 
off in a random direction. By the same 



token, there may be an advantage to 
reading a scroll (type an r) before dis- 
carding it: certain formulas remove 
the curse from one's armor. 

The most impressive magic devices 
at the Rogue's disposal are wands. De- 
pending on the type of wand picked up, 
the Rogue may zap a monster (type a 
z) with various effects: he may trans- 
port it to a random location, shoot 
fireballs at it or change it into another 
monster. The last type of wand, called 
a polymorph wand, is best used on the 
more horrible monsters: it is much 
better to transform the dread Purple 
Worm into a bat than vice versa. 

When the Rogue discovers a mon- 
ster, a good policy might be to leave it 
alone. Sometimes a monster is sleeping 
and will not attack if left undisturbed. 
If a fight seems inevitable, however, 
one may wield a weapon (type a w) 
and then fight to the death (type an/). 
This can be done only after one has 
moved the Rogue next to the monster. 
The outcome of the struggle will de- 
pend probabilistically on such factors 
as the Rogue's current strength level, 
degree of experience and armor class. 

Foremost in the ranks of players of 
Rogue stands a top-caliber nonhuman 
player. For the past four years a com- 
puter program has been playing the 
game and matching the prowess of 
the best Rogue runners in the quest 
for the amulet and gold; it provides 
as well an intriguing opportunity to 
watch an expert system at work. 

On February 16, 1984, at the Uni- 
versity of Texas at Austin, a Rogue 
manipulated by a program fought off 
all monsters, amassed a considerable 
pile of gold and returned with the amu- 
let. Bearing the distinctly un-Tolkien- 
esque name of rog-o-matic, this pro- 
gram directed the Rogue's every step, 
every pause, every throw and blow. 

ROG-o-MATic is the creation of four 



graduate students in the Computer Sci- 
ence Department at Carnegie-Mellon 
University in Pittsburgh: Andrew Ap- 
pel, Leonard Hamey, Guy Jacobson 
and Michael Mauldin. rog-o-matic 
links programmed knowledge sources 
with expert systems to make decisions 
about what to do in every conceivable 
underground situation. 

When a human plays Rogue, a 
stream of commands from the key- 
board flows by way of the operating 
system into the rogue program. The 
program automatically decides which 
monster to confront the Rogue with 
next, which layout to use for the next 
level of dungeons, and so on. The pro- 
gram transmits this information, again 
by way of the operating system, to the 
display screen in order to keep the hu- 
man informed of the current situation. 

In replacing a human player, the 
ROG-o-MATic program intercepts the 
keyboard character stream and trans- 
mits characters of its own to the rogue 
program. The latter has no idea (so to 
speak) that another program is play- 
ing. By the same token, information 
directed by the rogue program to the 
screen is also directed toward the rog- 
o-MATic program so that it can keep its 
own map of the Dungeons of Doom. 

The ROG-o-MATic program consists 
of 12,000 lines of the programming 
language C; it is even longer and more 
complicated than the rogue program. 
ROG-O-MATIC began in 1981 as what its 
original creators, Appel and Jacobson, 
thought would be a "simple project." 
Shortly after Mauldin joined the group 
the early Rogue-playing program went 
through an extensive round of modifi- 
cations, each version adding some en- 
hancement in tactical or strategic play. 
By the time the fourth member, Ha- 
mey, was contributing to program de- 
velopment, it was beginning to dawn 
on the authors that they had created, 
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in effect, an expert system. Such sys- 
tems constitute a key application of 
the so-called Fifth Generation of com- 
puters, projected to arrive in the mar- 
ketplace in the late 1980's. An expert 
system is designed to embody and 
project human expertise in a variety of 
areas from medicine to engineering. 

By using the type of software archi- 
tecture that is suited to expert systems, 
the creators of rog-o-matic were able 
to design and modify their program 
with relative ease. In particular, they 
organized the kinds of knowledge and 
expertise required by the Rogue into a 
hierarchy of various subsystems [see 
illustration below]. 

For example, one high-level expert 
(called Melee) controls fighting dur- 
ing combat and another high-level ex- 
pert (called Target) directs the Rogue's 
pursuit of monsters. Both these experts 
use a lower-level expert called battle, 
which carries out special attacks or ini- 
tiates retreat as the situation demands. 
The battle expert thus sometimes calls 
on the retreat expert for help, and the 
latter invariably draws on a source of 
knowledge called pathc. This is a spe- 
cial algorithm that searches the local 
terrain for the shortest path to which- 
ever location is specified. Shortest- 
path algorithms are well developed in 
general, and in this particular applica- 
tion only the fastest algorithm possible 
is acceptable; it is used almost contin- 
uously as ROG-o-MATic cxplorcs the 
Dungeons of Doom. Knowledge about 
terrain used by pathc comes from ter- 
map, essentially a data structure re- 
cording the terrain features so far dis- 
covered by the Rogue as he explores 
a particular level of the dungeons. Fi- 
nally, termap obtains all its knowledge 
from sense, a low-level data structure 
containing all the relevant output of 
the ROGUE program. 

Before listing the duties of other ex- 
perts and knowledge sources, I should 
like to reexamine one of the experts. 



battle, in more detail. Once a battle is 
under way, the melee expert calls on 
the battle expert to decide whether to 
attack or to retreat. Discretion being 
the better part of valor, the battle ex- 
pert first determines the desirability 
and feasibility of retreat. In order to do 
so it must check some preconditions: 

1 . The Rogue is not currently under 
the influence of the potion of confu- 
sion (which could cause the Rogue to 
flee directly toward the monster). 

2. A monster is not already holding 
the Rogue fast. 

3. It would be possible to die in one 
melee round (avoiding conflict would 
thus be highly desirable). 

4. The retreat expert can find an es- 
cape route (a retreat is possible). 

If all four preconditions are met, 
ROG-o-MATic will turn the matter of the 
Rogue's retreat over to the retreat ex- 
pert. If they are not met, the battle 
expert now runs through a list of ag- 
gressive possibilities. 

1. If it is possible for the Rogue to 
die in one melee round, if the monster 
is nearby and visible to the Rogue and 
if the Rogue happens to have a tele- 
portation wand, then point the wand 
at the monster. 

2. If it is possible for the Rogue to 
die in one melee round, if the monster 
is nearby and if the Rogue has a tele- 
portation scroll, then read the scroll's 
magic formula. 

If neither of these conditions pre- 
vails in an encounter, there is no long- 
er an alternative to going at least one 
round with the monster, and so the 
ROG-O-MATIC program cheerfully com- 
mits its Rogue persona to the battle. 
Perhaps the Rogue is strong enough 
to endure at least one melee round. 
Otherwise he may well be killed. 

Other experts used by the program 
include an exploration expert (explore), 
which decides where to explore next 
and what motions to use. Also includ- 
ed are a missile expert, which handles 




Expert subsystems and knowledge sources used by the program ROGUE 
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the firing of arrows, rocks, spears and 
so on at monsters, an expert for choos- 
ing which objects to pick up, called ob- 
ject, an expert for choosing what armor 
to wear, an expert at using magic and 
an expert called health, which decides 
when to eat or rest. Objmap is a data 
structure that keeps track of the loca- 
tion and history of all objects so far en- 
countered, invent is an inventory of 
items in the Rogue's backpack and in- 
tern is an internal-state recognizer that 
watches over the Rogue's readiness 
for exertion. 

It is no surprise that rog-o-matic 
can play a game of Rogue quickly. 
After a few minutes of computer time 
it is all over one way or the other. 
To date the program has played more 
than 12,000 games of Rogue at Car- 
negie-Mellon alone; statistics cited by 
ROG-o-MATic's four Creators tend to 
support the claim that the program's 
abilities now exceed those of the vast 
majority of human Rogue-playing ex- 
perts. For example, in a test conducted 
at Carnegie-Mellon during a three- 
week period in 1983, rog-o-matic had 
a higher median score than any of the 
15 top Rogue players at the university. 
rog-o-matic both outperforms most 
humans and shows some striking dif- 
ferences from them in its style of play. 
According to Mauldin, the program is 
careful and unimaginative. It explores 
efliciently and avoids all the redundant 
searches that humans are likely to un- 
dertake. Its fighting style, however, is 
rather methodical and, unless it is 
lucky, it misses some of the swash- 
buckling possibilities of human play. 

Consider, for example, the factor of 
luck in its history-making perform- 
ance last February at the University 
of Texas at Austin. After overcoming 
the incredible dangers of the deepest 
levels of the Dungeons of Doom, the 
Rogue (under rog-o-matic direction, 
of course) found the Amulet of Yen- 
dor in a passageway on the 26th lev- 
el. Racing toward the surface with his 
prize, the Rogue encountered on the 
22nd level one of the worst dungeon 
monsters, a fire-breathing dragon. The 
Rogue drew his sword but the dragon 
exhaled a bolt of fire first. The sear- 
ing flame missed the Rogue, who was 
standing in a doorway at the time, 
struck a wall and bounced directly 
back at the dragon, scorching it severe- 
ly. With its remaining strength the 
dragon advanced toward the Rogue, 
who dispatched it with a sword blow. 
The Rogue then continued on to the 
surface, dealing with minor monsters 
as he went. When he emerged into the 
light of day, he had in his possession 
not only the amulet but also 6,913 
pieces of gold and other objects. 

The reader, if intrigued by the fore- 



going account, may want to sample the 
fun. For that purpose the following 
puzzle was constructed by Mauldin. In 
addition to being an introduction to 

the joys of playing Rogue, it illustrates 
the difficulty of building intelligence 
into the rog-o-matic program. 

A chamber on the 26th level of the 
Dungeons of Doom is currently inhab- 
ited by the Purple Worm (P), the Grif- 
fin (G) and the Rogue (@). The Amu- 
let of Vendor (,) lies on the far side 
of a stairway (%) with respect to 
the Rogue. 
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The Rogue's goal is to grab the am- 
ulet and race up the stairway with- 
out getting killed. It happens that the 
Rogue has only one hit point left and 
cannot risk a confrontation with either 
the Purple Worm or the Griffin. Fortu- 
nately the Purple Worm is fast asleep 
and the Rogue, wearing the Ring of 
Stealth, has only to avoid stepping on it 
in order not to wake it up. The Griffin, 
on the other hand, is very much awake 
and in pursuit of the Rogue. Although 
the Griffin would never disturb a fel- 
low monster, it would like very much 
to occupy the same point as the Rogue, 
whom it would dismember with one 
slash of its cruel claws. 

It is the Rogue's turn to move. Each 
move by either the Rogue or the Grif- 
fin involves occupying any of the eight 
adjacent points. So single-minded is 
the Griffin that it always chooses a 
move on the most direct path to its 
prey. If the Rogue makes it to the stair- 
way, he is safe from both the Griffin 
and the Purple Worm: monster union 
rules forbid pursuit to other levels. 

Iast November's article on the Tower 
of Hanoi and the Chinese rings 
drew a variety of responses ranging 
from the mathematical to the meta- 
physical. Simple, nonrecursive solu- 
tions to the puzzles were presented 
by several readers, including Edward 
T. Price of Eugene, Ore. He suggests 
that Tower disks be painted alternately 
in two coloi's, say black and white, in 
order of increasing size. The puzzle is 
then solved quickly by adding the fol- 
lowing rule to the ones originally giv- 
en: Never place a disk on another disk 
of the same color. There is then no 
choice about where each one should 
be placed. The corresponding puzzle 
posed for the Chinese rings was solved 
by Morris S. Samberg of Howard 
Beach, N.Y. One alternates between 
moving (slipping on or off) the first 



ring and moving some other ring. Only 
one other ring may ever be moved. If 
the number of rings is odd, start with 
the first ring; otherwise start with 
the other one. Rob Hardy of Dayton, 
Ohio, summarizes this simple solution 
in the following verse: 

An iterative solution 
That's sure to spoil the fun: 
Alternate changing the end ring 
With changing some other one. 

No reader was able to find a simple 
mathematical scheme behind the King 
Wen ordering of / Ching hexagrams. 
Many readers observed that hexa- 
grams are paired across columns in a 
simple way, but this hardly explains 
the overall order. Homer E. Brown, 
an electrical-engineering consultant in 
Cary, N.C., produced a rather sugges- 
tive analysis, however: From each 
hexagram count up or down 10 hexa- 
grams, skipping from the end of one 
column to the beginning of the next if 
necessary. The hexagram thus arrived 
at always has a simple relation to the 
one started with. The rule is not deter- 
ministic, however, as one never knows 
whether to count up or down. 

In spite of this seeming relation 
(which has a number of exceptions 
in any event), I incline to the view 
that King Wen's arrangement follows 
metaphysical principles. Our attempt 
to project current preoccupations with 
science and technology into past cul- 
tures results in a distorted view of what 
once was. As a general rule the "scien- 
tific" systems that once existed served 
a role strictly subservient to a largely 
religious world view. Similar opinions I 
are offered by Bernard X. Bovasso 
of Saugerties, N.Y. The / Ching is 
concerned with the ordering of time, 
maintains Bovasso, and so was King 
Wen. David White, a philosopher at 
Macalester College in St. Paul, Minn., 
referred to a translation of the / Ching 
by James Legge [see "Bibliography," 
page 128]. An appendix to this work 
lays out a metaphysic governing the 
order of all 64 hexagrams. For ex- i 
ample, the first three are connected re- 
spectively with the concepts of heaven, | 
earth and chaos. The chaos hexagram, , 
denoting what is regarded as the disor- 
der of all created things taken collec- 
tively, follows heaven and earth since 
all created things fill the space between 
heaven and earth. 

Readers attempting to solve the 9- 
by-9 pursuit problem in the Decem- 
ber column on sharks and fish may 
have become enmeshed in unneces- 
sary complications. The ocean grid con- 
taining the two sharks and three fish 
should have been 9 by 10, therefore 
add one more vertical line to the grid. 



©1985 SCIENTIFIC AMERICAN, INC 




Tina has never 
had aTeddy Bear. 

A mother's love. A doll to cuddle. 
Tina knows nothing of these things. 
But she does know fear, rejection, 
and hunger. 

For just $18 a month, you can help 
save a child like Tina. 

Through our sponsorship program 
you can help provide a child with a 
better diet, clothes, medical attention, 
school. And even a toy or two. 

But don't wait. There are so many. 
And somewhere, right now, a child 
is dying from starvation and neglect, 
p ^ 

I Write to: Mrs. Jeanne Clarke Wood I 
I Children, Incorporated. P. O. Box 5381 I 
I Dept SA2T5. Richmond, Va. 23220 USA I 

r □ I wish to sponsor a □ boy, □ girl, in ■ 

' D Asia, □ Latin America, □ Middle East, J 

I D Africa, □ USA, □ Greatest Need. • 

I □ I will give $18 a month ($216 a year). ' 

I Enclosed in my gift for a full year □ , the I 

I first month □. Please send me the child's | 

• name, story, address and picture. ■ 

■ □ I can't sponsor, but will help * ■ 
S □ Plbase send me further information. ■ 

1 sas I 

I DCk/Money Order DVisa □ Master Card ■ 

■ 1-800-538-5381 ! 

1 CHILDREN, INC. * 

2 M.S. gifts are fully tax deductible. a 
I Annual financial statements are available on request. I 
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